RSMTool: collection of tools building and evaluating automated scoring models
نویسندگان
چکیده
منابع مشابه
Automated Tools for Subject Matter Expert Evaluation of Automated Scoring
As automated scoring of complex constructed-response examinations reaches operational status, the process of evaluating the quality of resultant scores, particularly in contrast to scores of expert human graders, becomes as complex as the data itself. Using a vignette from the Architectural Registration Examination (ARE), this paper explores the potential utility of classification and regressio...
متن کاملBuilding and Evaluating a Pattern Collection for the Domain of Workflow Modeling Tools
In this paper, we present the results of a case study conducted together with a small company that develops a workflow modeling tool. During the case study, we created a pattern collection for the domain of workflow modeling tools and evaluated a subset of these patterns. Beside the pattern description itself, the contribution of our work is a systematic process for identifying patterns. The re...
متن کاملBuilding Better Open-Source Tools to Support Fairness in Automated Scoring
Automated scoring of written and spoken responses is an NLP application that can significantly impact lives especially when deployed as part of high-stakes tests such as the GRE® and the TOEFL®. Ethical considerations require that automated scoring algorithms treat all testtakers fairly. The educational measurement community has done significant research on fairness in assessments and automated...
متن کاملBuilding-up an Automated Data Collection System
The need for gathering real-time information in building and industrial environments has increased in recent years. In the building environment, along with automatic utility meter reading, other information is increasingly needed e.g. room temperatures or device conditions. In the industrial environment, for instance in the paper industry, information on paper reel locations is essential when d...
متن کاملBuilding Automated Vandalism Detection Tools for Wikidata
Wikidata, like Wikipedia, is a knowledge base that anyone can edit. This open collaboration model is powerful in that it reduces barriers to participation and allows a large number of people to contribute. However, it exposes the knowledge base to the risk of vandalism and low-quality contributions. In this work, we build on past work detecting vandalism in Wikipedia to detect vandalism in Wiki...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
ژورنال
عنوان ژورنال: The Journal of Open Source Software
سال: 2016
ISSN: 2475-9066
DOI: 10.21105/joss.00033